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Abstract 

We give highly efficient algorithms, and almost matching lower bounds, for a range of basic statistical 
problems that involve testing and estimating the Li (total variation) distance between two fc-modal distributions 
p and q over the discrete domain {1, . . . , 7i}. More precisely, we consider the following four problems: given 
sample access to an unknown fc-modal distribution p. 

Testing identity to a known or unknown distribution: 

1 . Determine whether p = q (for an explicitly given fc-modal distribution q) versus p is e-far from q; 

2. Determine whether p ^ q (where q is available via sample access) versus p is e-far from q; 

Estimating Li distance ("tolerant testing") against a known or unknown distribution: 

3. Approximate drviPi o) to within additive e where q is an explicitly given fc-modal distribution q; 

4. Approximate drvip, q) to within additive e where q is available via sample access. 

For each of these four problems we give sub-logarithmic sample algorithms, that we show are tight up to 
additive poly(fc) and multiplicative polyloglogrT, + polylogfc factors. Thus our bounds significantly improve 
the previous results of IIBKR04I . which were for testing identity of distributions (items (1) and (2) above) in 
the special cases fc = (monotone distributions) and fc = 1 (unimodal distributions) and required 0((log n)^) 
samples. 

As our main conceptual contribution, we introduce a new reduction-based approach for distribution-testing 
problems that lets us obtain all the above results in a unified way. Roughly speaking, this approach enables us to 
transform various distribution testing problems for fc-modal distributions over {1, . . . , n} to the corresponding 
distribution testing problems for unrestricted distributions over a much smaller domain {!,...,£} where i = 
0{k \ogn). 
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1 Introduction 



Given samples from a pair of unknown distributions, the problem of "identity testing" — that is, distinguishing 
whether the two distributions are the same versus significantly different — and, more generally, the problem of 
estimating the Li distance between the distributions, is perhaps the most fundamental statistical task. Despite a 
long history of study, by both the statistics and computer science communities, the sample complexities of these 
basic tasks were only recently established. Identity testing, given samples from a pair of distributions of support [n], 
can be done using 0{v?/'^) samples jBFR+OOt . and this upper bound is optimal up to polylog(n) factors HValOSall . 
Estimating the Li distance ("tolerant testing") between distributions of support [n] requires 0(n/logn) samples, 
and this is tight up to constant factors MVVllal IVVllbl . The variants of these problems when one of the two 
distributions is explicitly given require Q{^/n) samples for identity testing jBFF+Oll and G(n/ log n) samples for 
Li distance estimation HVVllalfVVllbll respectively. 

While it is surprising that these tasks can be performed using a sublinear number of samples, for many real- 
world applications using y/n, ■n?/'^, or samples is still impractical. As these bounds characterize worst- 
case instances, one might hope that drastically better performance may be possible for many settings typically 
encountered in practice. Thus, a natural reseaixh direction, which we pursue in this paper, is to understand how 
structural properties of the distributions in question may be leveraged to yield improved sample complexities. 

In this work we consider monotone, unimodal, and more generally A;-modal distributions. Monotone, uni- 
modal, and bimodal distributions abound in the natural world. The distribution of many measurements — heights 
or weights of members of a population, concentrations of various chemicals in cells, parameters of many atmo- 
spheric phenomena-often belong to this class of distributions. Because of their ubiquity, much work in the natural 
sciences rests on the analysis of such distributions (for example, on November 1, 20 11 a Google Scholar search for 
the exact phrase "bimodal distribution" in the bodies of papers returned more than 90,000 hits). Though perhaps 
not as pervasive, fc-modal distributions for larger values of k commonly arise as mixtures of unimodal distributions 
and are natural objects of study. On the theoretical side, motivated by the many applications, monotone, unimodal, 
and fc-modal distributions have been intensively studied in the probability and statistics literatures for decades, see 
e.g. IIGre56[ lRao69l IBBBB72I ICKC831 IGro85[ IBir87a[ iBirSTbl IKem91[ lFbu97l ICTOl |JW09l . 

1.1 Our results. Our main results are algorithms, and nearly matching lower bounds, that give a complete picture 
of the sample complexities of identity testing and estimating Li distance for monotone and A;-modal distributions. 
We obtain such results in both the setting where the two distributions ai^e given via samples, and the setting where 
one of the distributions is given via samples and the other is described explicitly. 

All our results have the nature of a reduction: performing these tasks on /c-modal distributions over [n] turns 
out to have almost exactly the same sample complexities as performing the corresponding tasks on arbitrary 
distributions over [k log n]. For any small constant k (or even k = 0((log n)^/'^)) and arbitrarily small constant e, 
all our results are tight to within either polylog log n or polylog log log n factors. See Table 1 for the new sample 
complexity upper and lower bounds for the monotone and /c-modal tasks; see Section |2] for the (exponentially 
higher) sample complexities of the general-distribution tasks on which our results rely. While our main focus is 
on sample complexity rather than running time, we note that all of our algorithms run in poly (log n, k, 1/e) bit 
operations (note that even reading a single sample from a distribution over [n] takes log n bit operations). 

We view the equivalence between the sample complexity of each of the above tasks on a monotone or unimodal 
distribution of domain [n] and the sample complexity of the same task on an unrestricted distribution of domain 
[logn] as a surprising result, because such an equivalence /a/Z^ to hold for related estimation tasks. For example, 
consider the task of distinguishing whether a distribution on [n] is uniform versus fai" from uniform. For general 
distributions this takes Q{y/n) samples, so one might expect the corresponding problem for monotone distributions 
to need ^log n samples; in fact, however, one can test this with a constant number of samples, by simply comparing 
the empirically observed probability masses of the left and right halves of the domain. An example in the other 
direction is the problem of finding a constant additive estimate for the entropy of a distribution. On domains of 
size [n] this can be done in samples, and thus one might expect to be able to estimate entropy for monotone 

distributions on [n] using ^J"^^"'^ samples. Nevertheless, it is not hard to see that ri(log^ n) samples are required. 
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Testing problem 



Our upper bound 



Our lower bound 



p, q are both monotone: 
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Testing identity, q is unknown: 
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p, q are both /c-modal: 
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Testing identity, q is unknown: 
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Estimating Li distance, q is known: 



f) I k \ k\ogn -4 ' 

^ ' log(fclogn) " " 



fc log n 



log(fc log n)-log log(fc log n) 



Estimating Li distance, q is unknown: 
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' log(felogn) 



k log n 

log(fc log n)-log log(fc log n) 



Table 1: Our upper and lower bounds for identity testing and Li estimation. In the table we omit a "log(l/(5)" term 
which is present in all our upper bounds for algorithms which give the correct answer with probability 1 — 6. For 
the "testing identity" problems, our lower bounds are for distinguishing whether p = q versus dTv{p,Q) > 1/2 
with success probability 2/3. For estimating Li distance, our bounds are for estimating dTv(Pi q) to within ite, 
for any k = 0{n^^'^), with the lower bounds corresponding to success probability 2/3. 



The reduction-like techniques which we use to establish both our algorithmic results and our lower bounds 
(discussed in more detail in Section lh2\ below) reveal an unexpected relationship between the class of /c-modal 
distributions of support [re] and the class of general distributions of support [k log re]. We hope that this reduction- 
based approach may provide a framework for the discovery of other relationships that will be useful in future work 
in the extreme sublinear regime of statistical property estimation and property testing. 

Comparison with prior work. Our results significantly extend and improve upon the previous algorithmic results 
of Batu et al IIBKR04II for identity testing of monotone or unimodal (k = 1) distributions, which required 0(log^ re) 
samples. More recently, HDDS 111 established the sample complexity of learning /c-modal distributions to be 
essentially 0(/c log(re)e~^). Such a learning algorithm easily yields a testing algorithm with the same sample 
complexity for all four variants of the testing problem (one can simply run the leai^ner twice to obtain hypotheses 
p and ^that are sufficiently close to p and q respectively, and output accordingly). 

While the HDDS 111 result can be applied to our testing problems (though giving suboptimal results), we stress 
that the ideas underlying HDDS 111 and this paper are quite different. The HDDS 111 paper learns a A;-modal distri- 
bution by using a known algorithm for learning monotone distributions UBirSTbl k times in a black-box manner; 
the notion of reducing the domain size — which we view as central to the results and contributions of this paper — is 
nowhere present in HDDS 111 . By contrast, the focus in this paper is on introducing the use of reductions as a 
powerful (but surprisingly, seemingly previously unused) tool in the development of algorithms for basic statistical 
tasks on distributions, which, at least in this case, is capable of giving essentially optimal upper and lower bounds 
for natural restricted classes of distributions. 

1.2 Techniques. Our main conceptual contribution is a new reduction-based approach that lets us obtain all our 
upper and lower bounds in a clean and unified way. The approach works by reducing the monotone and /c-modal 
distribution testing problems to general distribution testing and estimation problems over a much smaller domain, 
and vice versa. For the monotone case this smaller domain is essentially of size log (re) /e, and for the /c-modal case 
the smaller domain is essentially of size k log(re) /e^ . By solving the general distribution problems over the smaller 
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domain using known results we get a valid answer for the original (monotone or /c-modal) problems over domain 
[n]. More details on our algorithmic reduction are given in Section lAl 

Conversely, our lower bound reduction lets us reexpress arbitrary distributions over a small domain [i] by 
monotone (or unimodal, or /c-modal, as required) distributions over an exponentially larger domain, while pre- 
serving many of their features with respect to the Li distance. Crucially, this reduction allows one to simulate 
drawing samples from the larger monotone distribution given access to samples from the smaller distribution, so 
that a known impossibility result for unrestricted distributions on [£] may be leveraged to yield a corresponding 
impossibility result for monotone (or unimodal, or A;-modal) distributions on the exponentially larger domain. 

The inspiration for our results is an observation of Birge IIBir87bll that given a monotone-decreasing probability 
distribution over [n], if one subdivides [n] into an exponentially increasing series of consecutive sub-intervals, the 
ith having size (1 + e)*, then if one replaces the probability mass on each interval with a uniform distribution on 
that interval, the distribution changes by only 0(e) in total variation distance. Further, given such a subdivision of 
the support into logl_^_^{n) intervals, one may essentially treat the original monotone distribution as essentially a 
distribution over these intervals, namely a distribution of support logi_^^{n). In this way, one may hope to reduce 
monotone distribution testing or estimation on [n] to general distribution testing or estimation on a domain of size 
logi^^(n), and vice versa. See Section |B]for details. 

For the monotone testing problems the partition into subintervals is constructed obliviously (without drawing 
any samples or making any reference to por q of any sort) - for a given value of e the partition is the same for all 
non-increasing distributions. For the fc-modal testing problems, constructing the desired partition is significantly 
more involved. This is done via a careful procedure which uses k"^ ■ poly(l/e) sample^ from p and q and uses the 
oblivious decomposition for monotone distributions in a delicate way. This construction is given in Section O 

2 Notation and Preliminaries 

2.1 Notation. We write [n] to denote the set {1, . . . , n}, and for integers i < j we write to denote the set 
{z, i + 1, . . . , j}. We consider discrete probability distributions over [77,], which are functions p : [n] — )■ [0, 1] such 
that Y17=iP('^) ~ ^- ^'^^ ^ — W write p{S) to denote J2iesP('^)- notation P for the cumulative 
distribution function (cdf) corresponding to p, i.e. P : [n] — > [0, 1] is defined by P{j) = J2i=i 

A distribution p over [71] is non-increasing (resp. non-decreasing) if p{i + 1) < p{i) (resp. p{i + 1) > p{i)), for 
alH G [n — 1]; p is monotone if it is either non-increasing or non-decreasing. Thus the "orientation" of a monotone 
distribution is either non-decreasing (denoted t) or non-increasing (denoted 4,). 

We call a nonempty interval / = [o, b] C [2, — 1] a max-interval of p if p{i) = a for all z G / and 
max{p(a — l),p{b + 1)} < c. Analogously, a min-interval of p is an interval / = [a, b] C [2,n — 1] with p{i) = c 
for alH G / and min{p(a — l),p(6 + 1)} > c. We say that p is k-modal if it has at most k max-intervals and 
min-intervals. We note that according to our definition, what is usually referred to as a bimodal distribution is a 
3-modal distribution. 

Let p, q be distributions over [n] with corresponding cdfs P, Q. The total variation distance between p and q 
is d'Tvip, q) '■= maxgcfn] \p{S) — q{S)\ = (1/2) Yliis^[n\ \p{^) ~ The Kolmogorov distance between p and q 
is defined as d^ip, q) '■= maxjg[„] \P{j) — Q{j)\ ■ Note that dxip, q) < d^vip, q)- 

Finally, a sub-distribution is a function q : [n] ^ [0, 1] which satisfies XlILi — 1- ^'^^ P ^ distribution over 
[n] and / C [n], the restriction of p to I is the sub-distribution p^ defined by p^{i) = p{i) if i G / and p^ {i) = 
otherwise. Likewise, we denote by pi the conditional distribution of p on /, i.e. pi{i) = p{i)/p{I) if 7 G / and 
pj{i) = otherwise. 

2.2 Basic tools from probability. We will require the Dvoretzky-Kiefer-Wolfowitz (DKW) inequality ( IIDKW56II ) 
from probability theory. This basic fact says that 0(l/e^) samples suffice to learn any distribution within error e 
with respect to the Kolmogorov distance. More precisely, let p be any distribution over [n] . Given m independent 

' Intuitively, the partition must be finer in regions of higher probability density; for non-increasing distributions (for example) this region 
is at the left side of the domain, but for general fc-modal distributions, one must draw samples to discover the high-probability regions. 
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samples si, . . . ,Sm drawn from p : [n] — )• [0, 1], the empirical distribution pm : [n] — )■ [0, 1] is defined as follows: 
for all i G [n], Pm{i) = \{j G [m] \ Sj = i}\/m. The DKW inequality states that for m = J7((l/e^) • ln(l/(5)), 
with probability 1 — 5 the empirical distribution pm will be e-close to p in Kolmogorov distance. This sample 
bound is asymptotically optimal and independent of the support size. 

Theorem 1 ( IIDKW56[|Mas90ll ). For all e > 0, it holds: FT[dK{p,Pm) > e] < 2e~2"»''. 

Another simple result that we will need is the following, which is easily verified from first principles: 

Observation 1. Let I = [a, b] be an interval and let uj denote the uniform distribution over I. Let pj denote a 
non-increasing distribution over L Then for every initial interval I' = [a, b'] of I, we have ui{I') < pi{I'). 

2.3 Testing and estimation for arbitrary distribution Our testing algorithms work by reducing to known algo- 
rithms for testing arbitrary distributions over an ^-element domain. We will use the following well known results: 

Theorem 2 (testing identity, known distribution IIBFF+OIID . Let q be an explicitly given distribution over [£]. Let 
p be an unknown distribution over [i] that is accessible via samples. There is a testing algorithm TesT-Identity- 
KN0WN(p, (/, e, (5) that uses sjK{i,e,6) := 0(£^/^ Iog(£)e~^ log(l/5)) samples from p and has the following 
properties: 

• ¥p = Q then with probability at least 1 — 5 the algorithm outputs "accept; " and 

• Ifd^viP: q) ^ ^ then with probability at least 1 — 6 the algorithm outputs "reject." 

Theorem 3 (testing identity, unknown distribution jBFR^lOl ). Let p and q both be unknown distributions over 
[£] that are accessible via samples. There is a testing algorithm TesT-Identity-UnkN0WN(p, q, e, 6) that uses 
siui^y ^1 ^) '■— 0(fil^ log(^/(5)e~^/'^) samples from p and q and has the following properties: 

• Ifp = q then with probability at least 1 — 5 the algorithm outputs "accept; " and 

• Ifd^vip, q) — ^ then with probability at least 1 — 6 the algorithm outputs "reject." 

Theorem 4 (Li estimation MVVllbll ). Let p be an unknown distribution over [i] that is accessible via samples, and 
let q be a distribution over [i] that is either explicitly given, or accessible via samples. There is an estimator Li- 
Estimate(p, q,e,6) that, with probability at least 1 — 6, outputs a value in the interval {dicv (p^ <l)~^i d^v (p^ q) + 
e). The algorithm uses SE{i, e, 6) := O ( ■ log(l/(5) j samples. 



3 Testing and Estimating Monotone Distributions 

3.1 Oblivious decomposition of monotone distributions Our main tool for testing monotone distributions is 
an oblivious decomposition of monotone distributions that is a variant of a construction of Birge IIBir87bi . As we 
will see it enables us to reduce the problem of testing a monotone distribution to the problem of testing an arbitrary 
distribution over a much smaller domain. 

Before stating the decomposition, some notation will be helpful. Fix a distribution p over [n] and a partition of 
[n] into disjoint intervals X := {/j}^^^. The flattened distribution (pj)-^ corresponding to p and X is the distribution 
over [n] defined as follows: for j G [£] and i G Ij, {pf)^{i) = X^^g/^. That is, (p/)"^ is obtained from 

p by averaging the weight that p assigns to each interval over the entire interval. The reduced distribution (pr)'^ 
corresponding to p and Z is the distribution over [£] that assigns the ith point the weight p assigns to the interval 
/«; i.e., for i G [i], we have {pr)'^{i) = p{Ii). Note that if p is non-increasing then so is {pf)^ , but this is not 
necessarily the case for {prf' . 

The following simple lemma, proved in Section |Al shows why reduced distributions ai^e useful for us: 

Definition 1. Let p be a distribution over [n] and let I = {li}^^^ be a partition of [n] into disjoint intervals. We 
say that X is a {p, e, £)-flat decomposition of [n] if dTviP-, {Pf)^) ^ ^• 
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Lemma 2. LetX = {Ii}l=\_ ^ partition of [n] into disjoint intervals. Suppose that p and q are distributions over 
[n] such that I is both a (p, e, i)-flat decomposition of [n] and is also a {q, e, i)-flat decomposition of [n]. Then 
\dTviP,q) - dTviiPr)^, iqr)^)\ < 2e. Moreover, ifp = q then {prf = (qr)^. 

We now state our oblivious decomposition result for monotone distributions: 

Theorem 5 ( IIBir87bll ). (oblivious decomposition) Fix any n G Z+ and e > 0. The partition X := {Lilf^i "/ 1"^]' 
in which the jth interval has size [(1 + e)-'] has the following properties: £ = O ((1/e) • log(e • n + 1)), and I is 
a {p, 0(e) , i)-flat decomposition of [n] for any non-increasing distribution p over [n]. 

There is an analogous version of Theorem [5] asserting the existence of an "oblivious" partition for non- 
decreasing distributions (which is of course different from the "oblivious" partition X for non-increasing distri- 
butions of Theorem [5]); this will be useful later. 

While our construction is essentially that of Birge, we note that the version given in IIBir87bll is for non- 
increasing distributions over the continuous domain [0, n], and it is phrased rather differently. Adapting the argu- 
ments of IIBir87bi to our discrete setting of distributions over [n] is not conceptually difficult but requires some 
care. For the sake of being self-contained we provide a self-contained proof of the discrete version, stated above, 
that we require in Appendix El 

3.2 Efficiently testing monotone distributions Now we ai^e ready to establish our upper bounds on testing 
monotone distributions (given in the first four rows of Table 1). All of the algorithms are essentially the same: 
each works by reducing the given monotone distribution testing problem to the same testing problem for arbitrary 
distributions over support of size i = 0(logn/e) using the oblivious decomposition from the previous subsection. 
For concreteness we explicitly describe the tester for the "testing identity, q is known" case below, and then indicate 
the small changes that are necessary to get the testers for the other three cases. 

Test-Identity- Known-Monotone 

Inputs: e,5 > 0; sample access to non-increasing distribution p over explicit description of non-increasing 
distribution q over [n] 

1. Let I := {Li}l^^, with £ = 0(log(en + l)/e), be the partition of [n] given by Theorem|5l which is a 
(p', e/8, £)-flat decomposition of [ii] for any non-increasing distribution p'. 

2. Let (qr)'^ denote the reduced distribution over [i] obtained from q using X as defined in Section lAl 

3. Draw m = sik{^, e/2, S) samples from (pr)^, where (pr)^ is the reduced distribution over [I] obtained 
from p using X as defined in Section lAl 

4. Output the result of Test-Identity- KNOWN((pr)'^, {qr)^, f , <5) on the samples from Step 3. 

We now establish our claimed upper bound for the "testing identity, q is known" case. We first observe that in 
Step 3, the desired m = sik{£, e/2, 6) samples from (pr)'^ can easily be obtained by drawing m samples from p 
and converting each one to the corresponding draw from (pr)'^ in the obvious way. If p = q then (pr)'^ = {qr)^, 
and Test- Identity-Known-Monotone outputs "accept" with probability at least 1 - 5 by Theorem |2] If 
d-TviP^ q) ^ ^' then by Lemma|2l Theorem|5]and the triangle inequality, we have that (iTv((j'r)'^i (qr)'^) ^ 3e/4, 
so Test-Identity- Known-Monotone outputs "reject" with probability at least 1 - 5 by Theorem El For 
the "testing identity, q is unknown" case, the the algorithm Test-Identity-Unknown-Monotone is very 
similar to Test-Identity- Known-Monotone. The differences are as follows: instead of Step 2, in Step 3 we 
draw m = sju(i, e/2, 6) samples from (pr)'^ and the same number of samples from (qr)'^; and in Step 4, we run 
TEST-lDENTlTY-UNKNOWN((pr)^, (qr)-^ , using the Samples from Step 3. The analysis is exactly the same 
as above (using Theorem |3l in place of Theorem |2l). 

We now describe the algorithm Li-Estimate-Known-Monotone for the "tolerant testing, q is known" 
case. This algorithm takes values e and 6 as input, so the partition X defined in Step 1 is a (p', e/4, ^)-flat de- 
composition of [n] for any non-increasing p'. In Step 3 the algorithm draws m = SE{i,e/2,S) samples and 
runs Li-ESTlMATE{{pr)-^ , (qrf' , e/2, 5) in Step 4. If d-^vip^ q) = c then by the triangle inequaUty we have that 
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dTviiPr)'^, {ItY') G [c - e/2, c + e/2] and Li-Estimate-Known-Monotone outputs a value within the pre- 
scribed range with probability at least 1-6, by TheoremHl The algorithm Li-Estimate-Unknown-Monotone 
and its analysis are entirely similar. 

4 From Monotone to A;-modal 

In this section we establish our main positive testing results for /c-modal distributions, the upper bounds stated 
in the final four rows of Table 1. In the previous section, we were able to use the oblivious decomposition to 
yield a partition of [n] into relatively few intervals, with the guarantee that the coiTcsponding flattened distribution 
is close to the true distribution. The main challenge in extending these results to unimodal or /c-modal distribu- 
tions, is that in order to make the analogous decomposition, one must first determine-by taking samples from 
the distribution-which regions are monotonically increasing vs decreasing. Our algorithm Construct-Flat- 
Decomposition(p, e, 5) performs this task with the following guarantee: 

Lemma 3. Let p be a k-modal distribution over [n]. Algorithm Construct-Flat-Decomposition(p, e, 5) 
draws 0{k'^€~^ log(l /6)) samples from p and outputs a {p, e, i)-flat decomposition of [n] with probability at least 
1 - 6, where i = 0{klog{n)/e^). 

The bulk of our work in Section O is to describe Construct-Flat-Decomposition(p, e, 6) and prove 
Lemma [21 but first we show how Lemma [3] yields our claimed testing results for A;-modal distributions. As in the 
monotone case all four algorithms are essentially the same: each works by reducing the given /c-modal distribution 
testing problem to the same testing problem for arbitrary distributions over [£]. One slight complication is that 
the partition obtained for distribution p will generally differ from that for q. In the monotone distribution setting, 
the partition was oblivious to the distributions, and thus this concern did not arise. Naively, one might hope that 
the flattened distribution corresponding to any refinement of a partition will be at least as good as the flattened 
distribution coiTcsponding to the actual partition. This hope is easily seen to be strictly false, but we show that it is 
true up to a factor of 2, which suffices for our purposes. 

The following terminology will be useful: Let X = and X' = be two partitions of [n] into r 

and s intervals respectively. The common refinement of X and X' is the partition J" of [n] into intervals obtained 
from X and X' in the obvious way, by taking all possible nonempty intervals of the form n /j . It is clear that J" is 
both a refinement of X and of X' and that the number of intervals | J^j in J" is at most r + s. We prove the following 
lemma in Section lAl 

Lemma 4. Let p be any distribution over [n], let X = {Ii}f^-^ be a {p,e,a)-flat decomposition of [n], and let 
J = \ Ji\\^Y ^ refinement ofX. Then J is a {p, 2e, h)-fiat decomposition of [n]. 

We describe the Test-Identity- Known-kmodal algorithm below. 



Test-Identity- Known-kmodal 

Inputs: e, 5 > 0; sample access to A;-modal distributions p, q over [n] 

1. Run Construct-Flat-Decomposition(p, e/2, (5/4) and let X = f = 0{k\og{n)/e^), 
be the partition that it outputs. Run Construct-Flat-Decomposition(p, e/2, 6/4) and let X' = 

i' = 0{k log(n)/e^), be the partition that it outputs. Let J be the common refinement of X and 
X and let £ J = 0{k log(n) /e^) be the number of intervals in J'. 

2. Let (qr)'^ denote the reduced distribution over [ij] obtained from q using J' as defined in Section lAl 

3. Draw m = sjKi^jj^f^jS/l) samples from {pr)'-^ , where (pr)'^ is the reduced distribution over [ij] 
obtained from p using J' as defined in Section lAl 

4. Run TEST-lDENTlTY-KNOWN((pr)'^, (qr)'^ , f , |) using the samples from Step 3 and output what it 
outputs. 
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We note that Steps 2, 3 and 4 of Test-Identity- Known-kmodal are the same as the corresponding steps 
of Test-Identity-Known-Monotone. For the analysis of Test-Identity-Known-kmodal, Lemmas [3] 
and|4]give us that with probability 1 — 5/2, the partition J obtained in Step 1 is both a (p, e, I j)-flat and (g, e,£j)- 
flat decomposition of [n]; we condition on this going forward. From this point on the analysis is essentially 
identical to the analysis for Test-Identity- Known-Monotone and is omitted. 

The modifications required to obtain algorithms Test-Identity-Unknown-KMODAL, Li-ESTIMATE- 
Known-KMODAL and Li-Estimate-Unknown-KMODAL, and the analysis of these algorithms, are completely 
analogous to the modifications and analyses of Section [J!2] and are omitted. 

4.1 The Construct-Flat-Decomposition algorithm. We present Construct-Flat-Decomposition(p, e, 5) 
followed by an intuitive explanation. Note that it employs a procedure ORlENTATlON(p, /), which uses no sam- 
ples and is presented and analyzed in Section l42l 



Construct-Flat-Decomposition 

Inputs: e,5 > 0; sample access to fc-modal distribution p over [n] 

1. Initialize X := 0. 

2. Fix r := e^/(20000fc). Draw r = 0(log(l/(^)/r^) samples from p and let p denote the resulting 
empirical distribution (which by Theorem[T]has d]^{p,p) < r with probability at least 1 — 6). 

3. Greedily partition the domain [n] into a atomic intervals {/i}f=i as follows: Ii := [1, ji], where ji := 
mm{j G [n] \ p{[l,j]) > e/(100A;)}. For i > 1, if U^^^Ij = [IJi], then I^+i := [ji + 1, ji+i], where 
ji+i is defined as follows: If p{[ji + l,7i\) > e/(100/c), then jj+i := m.m{j e [n] \ p{[ji + > 
e/{100k)}, otherwise, jj+i := n. 

4. Construct a set of moderate intervals, a set of heavy points, and a set of n„ negligible intervals as 
follows: For each atomic interval U = [a, 6], 

(a) if p{[a, b]) < 3e/(100fc) then Jj is declai^ed to be a moderate interval; 

(b) otherwise we have p{[a, b]) > 3e/{100k) and we declare 6 to be a heavy point. If a < b then we 
declai^e [a, 6 — 1] to be a negligible interval. 

For each interval / which is a heavy point, add / to X. Add each negligible interval / to I. 

5. For each moderate interval /, run procedure ORlENTATlON(p, /); let o g {|, |, _L} be its output. 
If o = _L then add I to I. 

If o =1 then let J/ be the partition of / given by Theorem |5] which is a (p', e/4, 0(log(n)/e))-flat 
decomposition of / for any non-increasing distribution p' over /. Add all the elements of J'j to X. 

If o =1 then let J'j be the partition of / given by the dual version of Theorem [51 which is a 
(p', e/4, 0(log(?i)/e))-flat decomposition of I for any non-decreasing distribution p' over /. Add all 
the elements of J'j to X. 

6. Output the partition X of [n] . 

Roughly speaking, when Construct-Flat-Decomposition constructs a partition X, it initially breaks [n] 
up into two types of intervals. The first type are intervals that are "okay" to include in a flat decomposition, either 
because they have very little mass, or because they consist of a single point, or because they are close to uniform. 
The second type are intervals that are "not okay" to include in a flat decomposition - they have significant mass 
and are far from uniform - but the algorithm is able to ensure that almost all of these are monotone distributions 
with a known orientation. It then uses the oblivious decomposition of Theorem [5] to construct a flat decomposition 
of each such interval. (Note that it is crucial that the orientation is known in order to be able to use Theorem |5l) 

In more detail, C0NSTRUCT-Flat-DeC0MP0SITI0n(p, e, 6) works as follows. The algorithm first draws a 
batch of samples from p and uses them to construct an estimate p of the CDF of p (this is straightforward using 
the DKW inequality). Using p the algorithm partitions [n] into a collection of 0{k/e) disjoint intervals in the 
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following way: 

• A small collection of the intervals are "negligible"; they collectively have total mass less than e under p. 
Each negligible interval / will be an element of the partition I. 

• Some of the intervals are "heavy points"; these are intervals consisting of a single point that has mass Q,{e/k) 
under p. Each heavy point / will also be an element of the partition X. 

• The remaining intervals are "moderate" intervals, each of which has mass @{e/k) under p. 

It remains to incorporate the moderate intervals into the partition X that is being constructed. This is done as 
follows: using p, the algorithm comes up with a "guess" of the correct orientation (non-increasing, non-decreasing, 
or close to uniform) for each moderate interval. Each moderate interval where the "guessed" orientation is "close to 
uniform" is included in the partition X. Finally, for each moderate interval / where the guessed orientation is "non- 
increasing" or "non-decreasing", the algorithm invokes Theorem|5]on / to perform the oblivious decomposition for 
monotone distributions, and the resulting sub-intervals are included in X. The analysis will show that the guesses 
ai"e almost always correct, and intuitively this should imply that the X that is constructed is indeed a {p,e, ^)-flat 
decomposition of [n]. 

4.2 The Orientation algorithm. The Orientation algorithm takes as input an exphcit distribution of a 
distribution p over [n] and an interval / C [n] . Intuitively, it assumes that pj is close (in Kolmogorov distance) to 
a monotone distribution p/, and its goal is to determine the orientation of pi: it outputs either t, 4, or _L (the last of 
which means "close to uniform"). The algorithm is quite simple; it checks whether there exists an initial interval 
/' of / on which p/'s weight is significantly different from uj{I') (the weight that the uniform distribution over I 
assigns to /') and bases its output on this in the obvious way. A precise description of the algorithm (which uses 
no samples) is given below. 



Orientation 

Inputs: explicit description of distribution p over [n]; interval / = [a, b] C [n] 

1. If |/| = 1 (i.e. / = {a} for some a G [n]) then return "_L", otherwise continue. 

2. If there is an initial interval /' = [a,j] of / that satisfies ui{I') — {p)i{I') > | then halt and output "t". 
Otherwise, 

3. If there is an initial interval I' = [a,j] of / that satisfies ui{I') — {p)i{I') < — f then halt and output 
"I". Otherwise, 

4. Output "_L". 

We proceed to analyze Orientation. We show that if pi is far from uniform then Orientation outputs 
the correct orientation for it. We also show that whenever ORIENTATION does not output "_L", whatever it outputs 
is the correct orientation of pi. The proof is given in Section IC3l 

Lemma 5. Let p be a distribution over [n] and let interval I = [a, 6] C [n] be such that pi is monotone. Suppose 
p{I) > 99e/ (lOOOOfc), and suppose that for every interval I' (1 I we have that \p{I') — p{I')\ < ToSoofc • 

1. If Pi is non-decreasing and pi is e/6-farfrom the uniform distribution uj over I, then ORIENTATION (p, I) 
outputs "'["; 

2. if Orient ATION{p, I) outputs "'[" then p J is non-decreasing; 

3. if Pi is non-increasing and pi is e/6-farfrom the uniform distribution ui over I, then ORlENTATlON(p, /) 
outputs "-l"; 

4. if Orientation (p, /) outputs "I" then pi is non-increasing. 
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5 Lower Bounds 



Our algorithmic results follow from a reduction which shows how one can reduce the problem of testing properties 
of monotone or fc-modal distributions to the task of testing properties of general distributions over a much smaller 
support. Our approach to proving lower bounds is complementary; we give a canonical scheme for transforming 
"lower bound instances" of general distributions to related lower bound instances of monotone distributions with 
much larger supports. 

A generic lower bound instance for distance estimation has the following form: there is a distribution D over 
pairs of distributions, {p,p'), with the information theoretic guarantee that, given s independent samples from 
distributions p and p', with {p,p') ^ D, it is impossible to distinguish the case that d-j^y{p,p') < ei versus 
d-TviPiP') > £2 with any probability greater than 1 — 5, where the probability is taken over both the selection of 
{p,p') ^ D and the choice of samples. In general, such information theoretic lower bounds are difficult to prove. 
Fortunately, as mentioned above, we will be able to prove lower bounds for monotone and A:-modal distributions 
by leveraging the known lower bound constructions in a black-box fashion. 

Definitions |2] and [3l given below, define a two-stage transformation of a generic distribution into a related 
A;-modal distribution over a much lai^ger support. This transformation preserves total variation distance: for any 
pair of distributions, the variation distance between their transformations is identical to the variation distance 
between the original distributions. Additionally, we ensure that given access to s independent samples from an 
original input distribution, one can simulate drawing s samples from the related A;-modal distribution yielded by 
the transformation. Given any lower-bound construction D for general distributions, the above transformation will 
yield a lower-bound instance Df^ for {k — l)-modal distributions (so monotone distributions correspond to k = 1) 
defined by selecting a pair of distributions {p,p') ^ D, then outputting the pair of transformed distributions. This 
transformed ensemble of distributions is a lower-bound instance, for if some algorithm could successfully test 
pairs of {k — l)-modal distributions from D^, then that algorithm could be used to test pairs from D, by simulating 
samples drawn from the transformed versions of the distributions. The following proposition, proved in Section iDl 
summarizes the above discussion: 

Proposition 6. Let D be a distribution over pairs of distributions supported on [n] such that given s samples from 
distributions p,p' with {p,p') ^ D,no algorithm can distinguish whether d^vip^p') ^ versus d'YviP^p') > ^2 
with probability greater than 1 — 5 ( over both the draw of {p, p') from D and the draw of samples from p, p'). Let 
Pmax , Pmin be the respective maximum and minimum probabilities with which any element arises in distributions 
that are supported in D. Then there exists a distribution over pairs of {k — l)-modal distributions supported 
on [N] = [4/i;e"r(^+^°s(P'""^/P'"»"))] such that no algorithm, when given s samples from distributions PkiP'kJ with 
{PktP'k) ^ ^k, can distinguish whether dTvipk^p'k) ^ versus dTvipk^p'k) > ^2 with success probability 
greater than 1 — 5. 

Before proving this proposition, we state various corollaries which result from applying the Proposition to 
known lower-bound constructions for general distributions. The first is for the "testing identity, q is unknown" 
problem: 

Corollary 7. There exists a constant c such that for sufficiently large N and 1 < k = 0{logN), there is a 
distribution over pairs of2{k — l)-modal distributions {p,p') over [N], such that no algorithm, when given 

log log N ) samples from a pair of distributions {p,p') ^ D, can distinguish the case that dTviP^p') — 
from the case d'YviPiP') > -5 with probability at least .6. 

This Corollary gives the lower bounds stated in lines 2 and 6 of Table 1. It follows from applying Proposition [6] 
to a (trivially modified) version of the lower bound construction given in llBFR+OOllWOSbl . summarized by the 
following theorem: 

Theorem 6 ( iBFR"'"00llVal08bl ). There exists a constant c such that for sufficiently large n, there is a distribution 
D over pairs of distributions {p,p') over [n], such that for any {p,p') ^ D, the maximum probability with which 
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any element occurs in p or p' is , and the minimum probability is Additionally, no algorithm, when given 
CTL^/^ samples from {p,p') ^ D, can distinguish whether d-rviPiP') = O,from d-j^viPiP') > -5 with probability 
at least .6. 

Our second corollary is for Li estimation, in the case that one of the distributions is explicitly given. This 
trivially also yields an equivalent lower bound for the setting in which both distributions ai^e given via samples. 

Corollary 8. For any a, b with < a < 6 < 1 /2, there exists a constant c > 0, such that for any sufficiently large 
N and 1 < k = 0{logN), there exists a 2{k — l)-modal distribution q of support [N], and a distribution Dk 
over 2{k — l)-modal distributions over [N], such that no algorithm, when given c A'^-iog log log samples from 
a distribution p D, can distinguish the case that d-^vip^ q) < o, versus d-j^viPiP') > b with probability at least 
.6. 

This Corollary gives the lower bounds claimed in lines 3, 4, 7 and 8 of Table 1. It follows from applying 
Proposition |6] to the lower bound construction given in llVVllall . summarized by the following theorem: 

Theorem 7 ( llVVllall ). For any a,b with < a < b < 1/2, there exists a constant c > 0, such that for 
any sufficiently large n, there is a distribution D over distributions with support [n], such that for any p 
the maximum probability with which any element occurs in p is O i^^^^p^ , and the minimum probability is 
Additionally, no algorithm, when given Cj^^ samples from p D can distinguish whether dTviPj^n) < a 
versus dxy (p, Un) > b with probability at least .6, where Un denotes the uniform distribution over [n]. 

Note that the above theorem can be expressed in the language of Proposition [6]by defining the distribution D' 
over pairs of distributions which chooses a distribution according to D for the first distribution of each pair, and 
always selects Un for the second distribution of each pair. 

Our third corollary, which gives the lower bounds claimed in lines 1 and 5 of Table 1 , is for the "testing identity, 
q is known" problem: 

Corollary 9. For any e G (0, 1/2], there is a constant c such that for sufficiently large N and \ <k = O(logm), 
there is a k-modal distribution p with support [N], and a distribution D over 2{k — \)-modal distributions of 
support [N] such that no algorithm, when given c{k log m)^/^ samples from a distribution p' ^ D, can distinguish 
the case that dTviP^p') — Ofrom the case dTviP^p') > ^ with probability at least .6. 

The above corollary follows from applying Proposition [6] to the following trivially verified lower bound con- 
struction: 

Fact 10. Let D be the ensemble of distributions of support n defined as follows: with probability 1/2, p ^ D 
is the uniform distribution on support n, and with probability 1/2, p ^ D assigns probability l/2n to a random 
half of the domain elements, and probability 3/2n to the other half of the domain elements. No algorithm, when 
given fewer than 77,^/^/100 samples from a distribution p <^ D can distinguish between d'YviPi Un) = versus 
dTviPi Un) > .5 with probability greater than .6. 

As noted previously (after Theorem IT]), this fact can also be expressed in the language of Proposition [6l 

6 Conclusions 

We have introduced a simple new approach for tackling distribution testing problems for restricted classes of 
distributions, by reducing them to general-distribution testing problems over a smaller domain. We applied this 
approach to get new testing results for a range of distribution testing problems involving monotone and fc-modal 
distributions, and established lower bounds showing that all our new algorithms are essentially optimal. 

A general direction for future work is to apply our reduction method to obtain near-optimal testing algorithms 
for other interesting classes of distributions. This will involve constructing flat decompositions of various types 
of distributions using few samples, which seems to be a natural and interesting algorithmic problem. A specific 
goal is to develop a more efficient version of our Construct-Flat-Decomposition algorithm for fc-modal 
distributions; is it possible to obtain an improved version of this algorithm that uses o{k) samples? 
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For simplicity, the appendix consists of a slightly expanded and self-contained version of the exposition 
in the body of the paper, following the "Notation and Preliminaries" section. 

A Shrinking the domain size: Reductions for distribution-testing problems 

In this section we present the general framework of our reduction-based approach and sketch how we instantiate 
this approach for monotone and fc-modal distributions. 

We denote by |/| the cardinality of an interval / C [n], i.e. for I = [a, b] we have |/| = b — a + 1. Fix a 
distribution p over [n] and a partition of [n] into disjoint intervals I := The flattened distribution {pf)^ 

con^esponding to p and X is the distribution over [n] defined as follows: for j G [i\ and i G Ij, {pf)^{i) = 
Ylt£i P{^)/\^i\- That is, {pf)^ is obtained from p by averaging the weight that p assigns to each interval over the 
entire interval. The reduced distribution {prY' corresponding to p and Z is the distribution over [£] that assigns 
the ith point the weight p assigns to the interval I^; i.e., for i G [I], we have {prY'{i) = p{Ii)- Note that if p is 
non-increasing then so is {pf)^, but this is not necessarily the case for {pr)^ ■ 

Definition[lJ Let p be a distribution over [n] and let X = {IiYi=i ^ partition of [n] into disjoint intervals. We 
say that X is a (p, e, £)-flat decomposition of [n] ifd^viPi (PfY) < ^■ 

The following useful lemma relates closeness of p and q to closeness of the reduced distributions: 

LemmaHI Let I = {/j}^^^ be a partition of [n] into disjoint intervals. Suppose that p and q are distributions over 
[n] such that I is both a (p, e, tj-flat decomposition of [n] and is also a {q, e, tj-flat decomposition of [n]. Then 
\dTv{p, q) - dTviiPrY, {qrY)\ < 2e. Moreover, ifp = q then {prY = [irY'- 

Proof. The second statement is clear by the definition of a reduced distribution. To prove the first statement, we 
first observe that for any pair of distributions p, q and any partition X of [n] into disjoint intervals, we have that 

diviiPvY, {qvY) = dTviiPfY, (qfY)- We thus have that \dTv{p, q) - dTviiPrf, {qr)^)\ is equal to 

\dTv{p,q) - dTviiPf) )\ = dTv{p,q) - dTviiPf) ^qf) ) <dTv{p,{pf) ) + dTv{q,{qf) ), 

where the equahty above is equivalent to d^v{P: q) ^ d'rviiPf)'^, iqf)^) (which is easily verified by considering 
each interval li ^ I sepai^ately and applying triangle inequality) and the inequality is the triangle inequality. Since 
X is both a {p, e, £)-flat decomposition of [n] and a {q, e, ^)-flat decomposition of we have that d^vip, {Pf)^) ^ 
e and dxy ((7, {qf)^) < £• The RHS above is thus bounded by 2e and the lemma follows. □ 

Lemma |2j while simple, is at the heart of our reduction-based approach; it lets us transform a distribution- 
testing problem over the large domain [n] to a distribution-testing problem over the much smaller "reduced" domain 
[£] . At a high level, all our testing algorithms will follow the same basic approach: first they run a procedure which, 
with high probability, constructs a partition X of [n] that is both a [p, e, ^)-flat decomposition of [n] and a {q, e, l)- 
flat decomposition of [n] . Next they run the appropriate general-distribution tester over the ^-element distributions 
{prf' , {qr)^ and output what it outputs; Lemma [2] guarantees that the distance between {pr)^ and {qrf' faithfully 
reflects the distance between p and q, so this output is correct. 

We now provide a few more details that are specific to the various different testing problems that we consider. 
For the monotone distribution testing problems the construction of X is done obliviously (without drawing any 
samples or any reference to p or g of any sort) and there is no possibility of failure - the assumption that p and q 
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are both (say) non-decreasing guarantees that the X that is constructed is both a (p, e, ^)-flat decomposition of [n] 
and a {q, e, £)-flat decomposition of [n]. We describe this decomposition procedure in Section [3TT] and present our 
monotone distribution testing algorithms that are based on it in Section [l!2l 

For the fc-modal testing problems it is not so straightforward to construct the desired decomposition X. This is 
done via a careful procedure which uses fc^ • poly(l/e) samples fromp and q. This procedure has the property that 
with probability 1—6/2, the X it outputs is both a {p, e, £) -flat decomposition of [n] and a (g, e, ^)-flat decomposition 
of [n], where £ = 0(/clog(n)/e^). Given this, by running a testing algorithm (which has success probability 
1 — (5/2) on the pair (pr)'^, {qr)^ of distributions over [I], we will get an answer which is with probability 1 — 5 a 
legitimate answer for the original testing problem. The details are given in Section ICl 

We close this section with a result about partitions and flat decompositions which will be useful later. Let 
X = , X' = {/j}^^]^ be two partitions of [n]. We say that X' is a refinement of X if for every i G [a] there is 

a subset Si of [h] such that VJj^sJ'j = h (note that for this to hold we must have a < b). Note that {Si}1^^ forms 
a partition of [h] . We prove the following useful lemma: 

Lemma m Let p be any distribution over [n], let X = {/j}"^]^ be a (p, e, a)-flat decomposition of [n], and let 
J = \ Ji\\^Y ^ refinement ofX. Then J is a {p, 2e, h)-fiat decomposition of [n\. 

Proof. Fix any i G [i] and let Si C \b] be such that /j = Uj^SiJj- To prove the lemma it suffices to show that 

2 E \p{t) - {Pffm > E E m - {Pff{t)i (1) 

t£ii jes t£jj 

since the sum on the LHS is the contribution that /j makes to d^vip, {Pf)^) ^rid the sum on the RHS is the 
corresponding contribution Ij makes to dTy(p, {pf)'^)- It may seem intuitively obvious that the sum on the LHS 
(which corresponds to approximating the sub-distribution using a "global average") must be smaller than the 
sum on the RHS (which corresponds to using separate "local averages"). However, this intuition is not quite 
correct, and it is necessary to have the factor of two. To see this, consider a distribution p over [n] such that 
p{l) = (1/2) • (1/n); p{i) = l/n for i G [2,n - 1]; and p(n) = (3/2) • (1/n). Taking h = [l,n/2] and 
I2 = [?^/2 + 1, n], it is easy to check that inequality ([T]) is essentially tight (up to a o(l) factor). 

We now proceed to establish Let T C [n] and consider a partition of T into k nonempty sets Ti,i G [k\. 

Denote =p{T)/\T\ and /li =p{Ti)/\Ti\. Then, © can be re-expressed as follows 

2E > E E \p{t)-^i^\. (2) 

teT i=i teTi 

We shall prove the above statement for all sequences of numbers p(l), . . . ,p{n). Since adding or subtracting 
the same quantity from each number p{t) does not change the validity of Q, for the sake of convenience we may 
assume all the numbers average to 0, that is, /i = 0. Consider the i-th term on the right hand side, EteT \pii)~l^i\- 
We can bound this quantity from above as follows: 

E W) -^i^\<E \pit)\ + |r,| • = E W)\ + \pm)\ = 2 E \p{t)\ = 2 E m - 1^\, 

teTi t€Ti teTi teTi teTi 

where the inequality follows from the triangle inequality (applied term by term), the first equality is by the defini- 
tion of fii, the second equality is trivial, and the final equality uses the assumption that f^i = 0. The lemma follows 
by summing over i G [k], using the fact that the Tj's form a partition of T. □ 

B Efficiently Testing Monotone Distributions 

B.l Oblivious decomposition of monotone distributions Our main tool for testing monotone distributions is 
an oblivious decomposition of monotone distributions that is a variant of a construction of Birge IIBir87bll . As we 
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will see it enables us to reduce the problem of testing a monotone distribution to the problem of testing an ai^bitrary 
distribution over a much smaller domain. The decomposition result is given below: 

Theorem |51 ( IIBir87bl ). (oblivious decomposition) Fix any n E Z"*" and e > 0. The partition I := {/ijf^i 
of [n] described below has the following properties: i = O ((1/e) • log(e • n + 1)), and for any non-increasing 
distribution p over [n], I is a (p, 0(e), i)-flat decomposition of[n]. 

There is a dual version of Theorem \5\ asserting the existence of an "oblivious" partition for non-decreasing 
distributions (which is of course different from the "oblivious" partition 1 for non-increasing distributions of 
Theorem ID; this will be useful later. 

While our construction is essentially that of Birge, we note that the version given in IIBir87bll is for non- 
increasing distributions over the continuous domain [0, 7i\, and it is phrased rather differently. Adapting the argu- 
ments of UBirSTbl to our discrete setting of distributions over [n] is not conceptually difficult but requires some 
care. For the sake of being self-contained we provide a self-contained proof of the discrete version, stated above, 
that we require in Appendix El 

B.2 Efficiently testing monotone distributions Now we ai^e ready to establish our upper bounds on testing 
monotone distributions (given in the first four rows of Table 1). All of the algorithms are essentially the same: 
each works by reducing the given monotone distribution testing problem to the same testing problem for arbitrary 
distributions over support of size i = 0(log n/e) using the oblivious decomposition from the previous subsection. 
For concreteness we explicitly describe the tester for the "testing identity, q is known" case below, and then indicate 
the small changes that are necessary to get the testers for the other three cases. 

Test-Identity-Known-Monotone 

Inputs: e,5 > 0; sample access to non-increasing distribution p over [n]; exphcit description of non-increasing 
distribution q over [n] 

1. Let X := {Li}f_i, with £ = 0(log(en + l)/e), be the partition of [n] given by Theorem[5l which is a 
(p', e/8, £)-fiat decomposition of for any non-increasing distribution p'. 

2. Let (qr)'^ denote the reduced distribution over [i] obtained from q using X as defined in Section lAl 

3. Draw m = sjk{£, e/2, S) samples from (pr)^, where (pr)^ is the reduced distribution over [£] obtained 
from p using X as defined in Section lAl 

4. Run Test-Identity- Known((p,.)^, (qr)^ , ^,5) using the samples from Step 3 and output what it 
outputs. 

We now establish our claimed upper bound for the "testing identity, q is known" case. We first observe that in 
Step 3, the desired m = sjk{£, e/2, 6) samples from (pr)'^ can easily be obtained by drawing m samples from p 
and converting each one to the corresponding draw from (pr)"^ in the obvious way. If p = q then by Lemma[2]we 
have that (p,.)^ = (qr)-^, and Test-Identity- Known-Monotone outputs "accept" with probabihty at least 
1 — 5 by Theorem|2] If dfv{p, q) > e> then by Lemma|2]and Theorem[5]we have that (iT\/((Pr)'^> {ir)^) ^ 3e/4, 
so Test-Identity- Known-Monotone outputs "reject" with probabihty at least I - 5 hy Theorem El For 
the "testing identity, q is unknown" case, the the algorithm Test-Identity-Unknown-Monotone is very 
similar to Test-Identity- Known-Monotone. The differences are as follows: instead of Step 2, in Step 3 we 
draw m = siu(£, e/2, 6) samples from {prY' and the same number of samples from (qr)^; and in Step 4, we run 
TEST-lDENTlTY-UNKNOWN((pr)'^, (^r)"^, ^,8) using the samples from Step 3. The analysis is exactly the same 
as above (using Theorem |3] in place of Theorem |2l). 

We now describe the algorithm Li-Estimate-Known-Monotone for the "tolerant testing, q is known" 
case. This algorithm takes values e and 5 as input, so the partition X defined in Step 1 is a (p', e/4, £)-flat decom- 
position of [n] for any non-increasing p' . In Step 3 the algorithm draws m = se{£, e/2, 6) samples and runs Li- 
ESTlMATE((pr)'^, (qr)'^, e/2, 6) in Step 4. If d^viP, q) = c then by Lemma|2]we have that (ixy ((Pr)"^, ilr)'^) ^ 
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[c- e/2, c + e/2] and Li -ESTIMATE- Known-Monotone outputs a value within the prescribed range with prob- 
ability at least 1 - (5, by TheoremH] The algorithm Li-Estimate-Unknown-Monotone case and its analysis 
are entirely similar. 

C Efficiently Testing A;-modal Distributions 

In this section we establish our main positive testing results for A:-modal distributions, the upper bounds stated in the 
final four rows of Table 1. The key to all these results is an algorithm Construct-Flat-Decomposition(p, e, 6). 
We prove the following performance guarantee about this algorithm: 

Lemma |3l Let p be a k-modal distribution over [n]. Algorithm Construct-Flat-Decomposition(p, e, (5) 
draws 0(fc^e~^ log(l/(5)) samples from p and outputs a (p, e, i)-flat decomposition of [n] with probability at least 
1-6, where £ = 0{klog{n)/e^). 

The bulk of our work in Section O is to describe Construct-Flat-Decomposition(p, e, (^) and prove 
Lemma [3l but first we show how Lemma [3] easily yields our claimed testing results for /c-modal distributions. 
As in the monotone case all four algorithms are essentially the same: each works by reducing the given A;-modal 
distribution testing problem to the same testing problem for arbitrary distributions over [i]. We describe the Test- 
Identity-Known-KMODAL algorithm below, and then indicate the necessary changes to get the other three 
testers. 

The following terminology will be useful: Let X = {It}-=i and X' = {Il}f^i be two partitions of [n] into r 
and s intervals respectively. The common refinement of X and X' is the partition J of [n] into intervals obtained 
from X and X' in the obvious way, by taking all possible nonempty intervals of the form /j n . It is clear that J 
is both a refinement of X and of X' and that the number of intervals \J\ in ^ is at most r + s. 

Test-Identity- Known-kmodal 

Inputs: e, 5 > 0; sample access to A;-modal distributions p, q over [n] 

1. Run Construct-Flat-Decomposition(p, e/2, (5/4) and let X = ^ = 0(A;log(n)/e^), 
be the partition that it outputs. Run Construct-Flat-Decomposition(p, e/2, 5/4) and let X' = 

i' = 0{k log(n)/e^), be the partition that it outputs. Let J' be the common refinement of X and 
X and let i J = 0{k log(n) /e^) be the number of intervals in J'. 

2. Let ((/r)"^ denote the reduced distribution over [ij] obtained from q using ^ as defined in Section lAl 

3. Draw m = s/j<-(^j7, e/2, 5/2) samples from {pr)'^, where (pr)"^ is the reduced distribution over [ij] 
obtained from p using J as defined in Section lAl 

4. Run Test-Identity- KNOWN((pr)"^, (qr)'^ , f , |) using the samples from Step 3 and output what it 
outputs. 

We note that Steps 2, 3 and 4 of Test-Identity- Known-kmodal are the same as the corresponding steps 
of Test-Identity- Known-Monotone. For the analysis of Test-Identity- Known-kmodal, Lemmas [3] 
and|4]give us that with probability 1 — 6/2, the partition J' obtained in Step 1 is both a {p, e, i j)-flat and {q, e,£j)- 
flat decomposition of [n]; we condition on this going forward. From this point on the analysis is essentially 
identical to the analysis for Test-Identity- Known-Monotone and is omitted. 

The modifications required to obtain algorithms Test-Identity-Unknown-kmodal, Li-Estimate- 
Known-KMODAL and Li-Estimate-Unknown-KMODAL, and the analysis of these algorithms, are completely 
analogous to the modifications and analyses of Appendix IB .21 and ai^e omitted. 

C.l The Construct-Flat-Decomposition algorithm. We present Construct-Flat-Decomposition(p, e, 5) 
followed by an intuitive explanation. Note that it employs a procedure Orientation(^, /), which uses no sam- 
ples and is presented and analyzed in Section l4i2l 
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Construct-Flat-Decomposition 

Inputs: e,5 > 0; sample access to A:-modal distribution p over [n] 

1. Initialize X :=$. 

2. Fix r := e^/(20000A:). Draw r = 0(log(l/(^)/r^) samples from p and let p denote the resulting 
empirical distribution (which by Theorem [T]has dY^(j),p) < r with probability at least 1 — 6). 

3. Greedily partition the domain [n] into a atomic intervals {-fij^i as follows: Ii := [1, ji], where ji := 
mm{j G [n] \ p{[l,j]) > e/(100A;)}. For i > 1, if U^.^ilj = then I^+i := [ji + where 
ji+i is defined as follows: If p{[ji + > e/(100A:), then jj+i := min{j G [n] \ p{[ji + > 
e/(100A;)}, otherwise, jj+i := n. 

4. Construct a set of n.^ moderate intervals, a set of n/i heavy points, and a set of n„ negligible intervals as 
follows: For each atomic interval Jj = [a, 6], 

(a) if p([a, 6]) < 3e/(100A;) then Ii is declared to be a moderate interval; 

(b) otherwise we have p{[a, h\) > 3e/(100A;) and we declare 6 to be a heavy point. If a < b then we 
declare [a, 6 — 1] to be a negligible interval. 

For each interval / which is a heavy point, add / to X. Add each negligible interval / to X. 

5. For each moderate interval /, run procedure ORIENTATION (p, /); let o g {|, J,, _L} be its output. 
If o = _L then add / to X. 

If o =1 then let J'j be the partition of / given by Theorem |5] which is a (p', e/4, 0(log(n)/e))-flat 
decomposition of / for any non-increasing distribution p' over /. Add all the elements of J'j to X. 

If o =1 then let J'j be the partition of / given by the dual version of Theorem [5j which is a 
(p', e/4, 0(log(?i)/e))-flat decomposition of / for any non-decreasing distribution p' over /. Add all 
the elements of J'j to X. 

6. Output the partition X of [n] . 

Roughly speaking, when Construct-Flat-Decomposition constructs a partition X, it initially breaks [n] 
up into two types of intervals. The first type are intervals that are "okay" to include in a flat decomposition, either 
because they have very little mass, or because they consist of a single point, or because they are close to uniform. 
The second type are intervals that are "not okay" to include in a flat decomposition - they have significant mass 
and are far from uniform - but the algorithm is able to ensure that almost all of these ai^e monotone distributions 
with a known orientation. It then uses the oblivious decomposition of Theorem[5]to construct a flat decomposition 
of each such interval. (Note that it is crucial that the orientation is known in order to be able to use Theorem |5l) 

In more detail, Construct-Flat-Decomposition(p, e, 6) works as follows. The algorithm first draws a 
batch of samples from p and uses them to construct an estimate p of the CDF of p (this is straightforward using 
the DKW inequality). Using p the algorithm partitions [n] into a collection of 0{k/e) disjoint intervals in the 
following way: 

• A small collection of the intervals are "negligible"; they collectively have total mass less than e under p. 
Each negligible interval / will be an element of the partition X. 

• Some of the intervals are "heavy points"; these are intervals consisting of a single point that has mass Q,{e/k) 
under p. Each heavy point / will also be an element of the partition X. 

• The remaining intervals ai^e "moderate" intervals, each of which has mass Q{e/k) under p. 

It remains to incorporate the moderate intervals into the partition X that is being constructed. This is done as 
follows: using p, the algorithm comes up with a "guess" of the correct orientation (non-increasing, non-decreasing, 
or close to uniform) for each moderate interval. Each moderate interval where the "guessed" orientation is "close to 
uniform" is included in the partition X. Finally, for each moderate interval / where the guessed orientation is "non- 
increasing" or "non-decreasing", the algorithm invokes Theorem|5]on / to perform the oblivious decomposition for 
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monotone distributions, and the resulting sub-intervals are included in X. The analysis will show that the guesses 
are almost always correct, and intuitively this should imply that the T that is constructed is indeed a (p, e, ^)-flat 
decomposition of \n\. 

C.2 Performance of Construct-Flat-Decomposition: Proof of LemmalU The claimed sample bound 
is obvious from inspection of the algorithm, as the only step that draws any samples is Step 2. The bound on 
the number of intervals in the flat decomposition follows directly from the upper bounds on the number of heavy 
points, negligible intervals and moderate intervals shown below, using also Theorem |5] It remains to show that the 
output of the algorithm is a valid flat decomposition of -p. First, by the DKW inequaUty (Theorem [D we have that 
with probability at least 1 — 5 it is the case that 

£2 

\W) - V{i)\ < YoO(M ' ^^^""^ mterval / C [n]. (3) 

We make some preliminary observations about the weight that p has on the intervals constructed in Steps 4 
and 5. Since every atomic interval Ij constructed in Step 4 has p{I) > e/(100A;) (except potentially the rightmost 
one), it follows that the number a of atomic intervals constructed in Step 3 satisfies 

a < [100A;/e]. 

We now establish bounds on the probability mass that p assigns to the moderate intervals, heavy points, and 
negligible intervals that are constructed in Step 4. Using each interval Ij that is declared to be a moderate 
interval in Step 4(a) must satisfy 

99e/(10000/c) < p{[a, b]) < 301e/(10000fc) (for all moderate intervals [a, b]). (4) 

By virtue of the greedy process that is used to construct atomic intervals in Step 3, each point b that is declared 
to be a heavy point in Step 4(b) must satisfy p{b) > 2e/(100A;) and thus using ^ again 

p{b) > 199e/(10000/c) (for all heavy points b). (5) 

Moreover, each interval [a, 6—1] that is declared to be a negligible interval must satisfy p([a, b — 1]) < e/ (lOO/c) 
and thus using ^ again 

p{[a, 6 - 1]) < 101e/(10000A;) (for all negligible intervals [a, b - 1]). (6) 

It is clear that rim (the number of moderate intervals) and Uh (the number of heavy points) are each at most a. 
Next we observe that the number of negligible intervals n„ satisfies 

n„ < k. 

This is because at the end of each negligible interval [a, 6 — 1] we have (observing that each negUgible interval must 
be nonempty) that p{b - 1) < p{[a, b - 1]) < 101e/(10000/c) while p{b) > 199e/(10000A;). Since p is fe-modal, 
there can be at most \{k + l)/2] < k points b G [n] satisfying this condition. Since each negligible interval / 
satisfies p{I) < lOle/ (10000/c) we have that the total probabihty mass under p of all the negligible intervals is at 
most lOle/10000. 

Thus far we have built a partition of [n] into a collection of rim < [lOO/c/e] moderate intervals (which we 
denote Mi, . . . , M„^), a set of < [100/c/e] heavy points (which we denote hi, ... , hn,^) and a set of n.„ < k 
negligible intervals (which we denote A^i, . . . , Nn^). Let A C {1, . . . , rim] denote the set of those indices i 
such that Orientation (p, Mi) outputs _L in Step 6. The partition X that Construct-Flat-Decomposition 
constructs consists of {hi}, ... , {hn^}, iVi, . . . , iV„„, {MjigA, and UiG([n„]\A) ^A/,- We can thus write p as 

p=E pihj) ■ ih, + E piN,)pN, + E piMj)pM, + E E pii)pi- (7) 

i=l j=l j&A j&{[nm]\A)l€jM. 
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Using Lemma [T5] (proved in AppendixlF]) we can bound the total variation distance between p and (f/)"^ by 



1 '^h 1 

d^viP, (Pff) < \p{h,) - {Pff{h,)\ + - E \p{Nj) - {pff{Nj)\ + E p{N,) . dTv{PN,,{{Pff)N,) 

^ j=i ^ j=i j=i 



+1 E \piMj) - {Pff{M,)\ + E p(M,) • dTv{PM,,{{Pff)M,) 

+^ E E E E (8) 



Since = (pf) (I) for every I ^ Z, this simpUfies to 

dTy(p, (p/f ) < E Pi^j) ■ dTv{PN,,{{Pff)N,) + E PiMj) ■ dTv{PM,,{{Pff)M,) 

+ E E (9) 

je([n™]\A) /G 

which we now proceed to bound. 

Recalling from ^ that p{Nj) < 101e/(10000/c) for each negligible interval Nj, and recalhng that n„ < k, 
the first summand in © is at most lOle/10000. 

To bound the second summand, fix any j G A so Mj is a moderate interval such that ORlENTATlON(p, Mj) re- 
turns ± . If pMj is non-decreasing then by Lemma[5]it must be the case that dxy {pMj AiPf )'^) Mj) < e/6 (note that 
{{Pf)^)Mj is just UMj, the uniform distribution over Mj). Lemma[5]gives the same bound \ipMj is non-increasing. 
If PMj is neither non-increasing nor non-decreasing then we have no nontrivial bound on diy(pMj, {{PfY')Mj)^ 
but since p is /c-modal there can be at most k such values of j in A. Recalling overall we have that 

tn 301eA; e 1968e 

E^P(M,) . d^vipM^iPf) )m,) < + g < 

and we have bounded the second summand. 

It remains to bound the final summand of Q. For each j e ([nm] \ A), we know that ORIENTATION (p, Mj) 
outputs either t or J,. If pj^j. is monotone, then by Lemma [5] we have that the output of ORlENTATlON(p, Mj) 
gives the correct orientation of pMy Consequently Jm^ is a (pA/^ , e/4, 0(log(n)/e))-flat decomposition of Mj, 
by Theorem[5l This means that d^viPMj, {{Pf)'^)Mj) < e/4, which is equivalent to 



E p(/)dTv(p/,((p/f)/)<T, i.e. E p{I)dTv{pi,{{Pf)'')i)<p{Mj) 



PiMj)ieJM^ 4 i^j^,^^ 4 

Let B C [rim] \ ^ be such that, for all j G B, pMj is monotone. Summing the above over all j £ B gives: 

E E PiI)dTviPi, {{Pf)^)i) < E PiM,) ■j<j. 

Given that p is k-modal, the cardinaUty of the set [um] \{ALI B) is at most k. So we have the bound: 

E E PiI)dTv{pi,{{Pf)^)i)< E P(^.)<T7^- 

So the third summand of ^ is at most e/4 + 301e/10000, and overall we have that ([9]) < |. Hence, we have 
shown that X is a {p, e, ^)-flat decomposition of [n], and Lemma[3]is proved. 
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C.3 The Orientation algorithm. The Orientation algorithm takes as input an explicit distribution of a 
distribution p over [n] and an interval / C [n]. Intuitively, it assumes that pi is close (in Kolmogorov distance) to 
a monotone distribution pj, and its goal is to determine the orientation of pj: it outputs either t, 4, or _L (the last of 
which means "close to uniform"). The algorithm is quite simple; it checks whether there exists an initial interval 
/' of / on which p/'s weight is significantly different from ui{I') (the weight that the uniform distribution over I 
assigns to I') and bases its output on this in the obvious way. A precise description of the algorithm (which uses 
no samples) is given below. 



Orientation 

Inputs: explicit description of distribution p over [n]; interval I = [a, h] C [n] 

1. If |/| = 1 (i.e. / = {a} for some a G [n]) then return "_L", otherwise continue. 

2. If there is an initial interval /' = [a, j] of / that satisfies ui{I') — {p)i{I') > I then halt and output 
"t". Otherwise, 

3. If there is an initial interval /' = [a,j] of / that satisfies uj{I') — {p)j{I') < — f then halt and 
output "I". Otherwise, 

4. Output "_L". 

We proceed to analyze ORIENTATION. We show that if pj is far from uniform then ORIENTATION outputs 
the con^ect orientation for it. We also show that whenever ORIENTATION does not output "_L", whatever it outputs 
is the correct orientation of pj. For ease of readability, for the rest of this subsection we use the following notation: 



Lemma m Let p be a distribution over [n] and let interval I = [a,b] C [n] be such that pi is monotone. Suppose 
p{I) > 99e/ (lOOOOA;), and suppose that for every interval I' C I we have that 



1. If Pi is non-decreasing and pi is e/6-farfrom the uniform distribution uj over I, then ORIENTATION (p, /) 
outputs "'["; 

2. if Orientation (p, /) outputs "f" then pj is non-decreasing; 

3. if Pi is non-increasing and pi is e/6-farfrom the uniform distribution uj over I, then OrientaTION(p, /) 
outputs "J,"; 

4. // Orientation (p, /) outputs "J," then pj is non-increasing. 

Proof. Let /' = [a, j] C / be any initial interval of /. We first establish the upper bound 



A 




W) - p{n\ < A. 



(10) 



Then 



\pi{l')-{p)i{l')\<e/A9 
as this will be useful for the rest of the proof. Using (ITOl ) we have 



(11) 





p{r)+p{i) 



(12) 



' p{I){p{I) - AY 
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Now using the fact that < p{I) and p{I) > 99e/(10000/c), we get that is at least 

^ 2p{I) _ 2 ■ 99A ^ 2 • 99A • lOOOO/c _ e 
' (98/99)p(/)2 ~ ~ 98p{I) - 98 • 99e ~ ~49" 

So we have estabUshed the lower bound pi{I') — {p)i{I') > — e/49. For the upper bound, similar reasoning gives 

< A. ,"'5'!/'^' <A. ^"f" 



< A 



+ A) - p(/)2 . (100/99) 
2 • lOOOOfc • 99 e 



99e • 100 50 



and so we have shown that \pi{I') — {p)i{I')\ < e/49 as desired. Now we proceed to prove the lemma. 

We first prove Part 1. Suppose that pi is non-decreasing and dTv{pi,ui) > e/6. Since pj is monotone and 
uj is uniform and both are supported on /, we have that the pdfs for pi and uj have exactly one crossing. An 
easy consequence of this is that dK{pi,uj) = d^vipuui) > e/6. By the definition of dx and the fact that pi is 
non-decreasing, we get that there exists a point j € / and an interval /' = [a, j] which is such that 

dK{pi,ui) = ui{l') -pi{l') > \. 

Using (fTTI ) we get from this that 

uAi') - iPhii') > i - ^ > 7 

and thus ORIENTATION outputs "f" in Step 3 as claimed. 

Now we turn to Part 2 of the lemma. Suppose that ORIENTATION (p, /) outputs "f". Then it must be the 
case that there is an initial interval /' = [a,j] of / that satisfies ui{I') — {p)i{I') > By (fTTI ) we have that 
uj{I') — pj{I') > f — ^ = |g- But Observation [J tells us that if pj were non-increasing then we would have 
ui{I') — pi{I') < 0; so pi cannot be non-increasing, and therefore it must be non-decreasing. 

For Part 3, suppose that pi is non-increasing and d-vvipi, ui) > e/6- First we must show that ORIENTATION 
does not output "f in Step 3. Since pi is non-increasing. Observation [Ugives us that ui{I') —pi{I') < for every 
initial interval /' of /. Inequahty (fTTI) then gives uj{I') — {p)j{I') < e/49, so ORIENTATION indeed does not 
output "t" in Step 3 (and it reaches Step 4 in its execution). Now arguments exactly analogous to the arguments 
for part 1 (but using now the fact that pj is non-increasing rather than non-decreasing) give that there is an initial 
interval /' such that {p)i{I') - ui{I') > | - ^ > |, so ORIENTATION outputs "J," in Step 4 and Part 3 of the 
lemma follows. 

Finally, Part 4 of the lemma follows from analogous arguments as Part 2. □ 



D Proof of Proposition [6] 

We start by defining the transformation, and then prove the necessary lemmas to show that the transformation 
yields fc-modal distributions with the specified increase in support size, preserves Li distance between pairs, and 
has the property that samples from the transformed distributions can be simulated given access to samples from 
the original distributions. 

The transformation proceeds in two phases. In the first phase, the input distribution p is transformed into 
a related distribution / with larger support; / has the additional property that the ratio of the probabilities of 
consecutive domain elements is bounded. Intuitively the distribution / corresponds to a "reduced distribution" 
from Section |A| In the second phase, the distribution / is transformed into the final 2{k — l)-modal distribution 
g. Both stages of the transformation consist of subdividing each element of the domain of the input distribution 
into a set of elements of the output distribution; in the first stage, the probabilities of each element of the set are 
chosen according to a geometric sequence, while in the second phase, all elements of each set are given equal 
probabilities. 

We now define this two-phase transformation and prove Proposition |6] 
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Definition 2. Fix e > and a distribution p OVCT [tx] such that Pmin Pmax for all i G [n] . We define 

the distribution fp.e,pmax,Pmin^'^ steps. Let q be the distribution on support [c] with c = 1 + \logi^^Pmax — 
^ogi_^_^ Pmin] that is defined by q{i) = (1 + e)'"-*- ■ The distribution fp,e,pmax,Pmin. has support [cn], and for 

i S [n] and j £ [c] it assigns probability p{i)q{j) to domain element c{i — 1) + j. 

It is convenient for us to view the mod r operator as giving an output in [r], so that "r mod r" equals r. 

Definition 3. We define the distribution gk,p,e,p„^ax,Pmin from distribution fp,e,p,nax,Pmin of support [m] via the 
following process. Let r = [^] , and let ai := 1, and for all i S {2, . . . ,r}, let ai := \{1 + e)aj_i]. For 

each i G [ml, we assign probability ■^P'^-P"'"^'^'"'"^'^ to each of the aj support elements in the set {1 + t,2 + 

f^i mod r 

t,---,ai mod r + where t = Yle=i ^{e mod r)- 

Lemma 11. Given e,pmm,Pmax, and access to independent samples from distribution p, one can generate inde- 
pendent samples from fp,e,p,^,x,Prmn and from gk,p,e,p^ax,P^^n- 

Proof. To generate a sample according to fp,e,p„iax,p,mn > '^^^ simply takes a sample i ^ p and then draws j G [c] 
according to the distribution q as defined in Definition |2] (note that this draw according to q only involves e,pmin 
and Pmax)- We then output the value c(i — 1) + j. It follows immediately from the above definition that the 
distribution of the output value is fp,e,pmax,p,^.n- 

To generate a sample according to gk,p,e,pr^ax,p„..,. given a sample i ^ fp,e,p^ax,Pmiu^ one simply outputs (a 
uniformly random) one of the a(j mod r) support elements of gk,p,e,pmax,Pmin con^esponding to the element i of 
fp,e,pmax,Prmn- Spcclfically, If thc support of /pe,p„a.,p™«„ is [m], then we output a random element of the set 
{l + t, 2 + t, . . . , ttj mod r + where t = mod r)) with Oj as defined in Definition[3j and r = [^] . □ 



Lemma 12. Ifpmin < p{i) < Pmax for all i G [n], then the distribution fp ^ p^^^ p^-^ of Definition^ with density 

fji) 



f : [cn] — )• M, has the property that J^l^i) < 1 + ^for all i > 1, and the distribution gk,p,e,p„^ax,Pniin of Definition\3\ 



is 2{k — l)-modal. 

Proof. Note that the distribution q, with support [c] as defined in Definition[2l has the property that q{i)/q{i — 1) = 
1 + e for alH G {2, . . . , c}, and thus f{€) //(£ — 1) = 1 + e for any I satisfying {I mod c) / 1. For values I that 
are 1 mod c, we have 

/(£) _ p{i + l) ^ p{i + l)p 

min ^ -, 



Given this property of fp,e,p„,ax,Prmn^ we now establish that 5fc,p,£,p™a.,p„„n is monotone decreasing on each of 
the k equally sized contiguous regions of its domain. First consider the case k = I; given a support element j, let 
i be such that j G {1 + a^, . . . , Oj + X^^Zi ae}. We thus have that 

/■\ _ fp,^, Pmax, Pmin (''') ^ + ^) fp,^,Pmax ,Pmini'^ ~ ^) fp,e,Pmax,Pmini''' ~ ^) ^ fj 

and thus gi,p,e,p,nax,Pmin Indccd 0-modal since it is monotone non-increasing. For k > 1 the above ai^guments 
apply to each of the k equally-sized contiguous regions of the support, so there ai^e 2{k — 1) modes, namely the 
local maxima occurring at the right endpoint of each region, and the local minima occurring at the left endpoint of 
each region. □ 

Lemma 13. For any distributions p,p' with support [n], and any €,pmax7Pmini we have that 

dlv{P,p') = dTV {fp,e, 

Pmaxipmin'> J P ^^tPmax iPmin 

) = dTV {gk,p,e, 

pmaxipmin ' gk,p',e,Pmax,Prmn) ' 
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Proof. Both equalities follow immediately from the fact that the transformations of Definitions |2] and [3]partition 
each element of the input distribution in a manner that is oblivious to the probabilities. To illustrate, letting 
c = 1 + [logi+e Pmax — logi+ePminl , and letting q be as in Definition^ we have the following: 

ie[n],j€[c] 

= Elp«-p'WI- 

ie[n] 

□ 



Lemma 14. Ifp has support [n] , then for any e < 1/2, the distribution gk,p,e,pmax,Pmin supported on [N], where 
jy IS at most k- 



Proof The support of /p,e,p„..,p„,„ is n(l + \log^+,Pma. - logi+,p™nl) < n (2 + l2S(£zWEp)^ . Letting 

ai := 1 and bi := \^] , and defining Oj := [aj_i(l + e)] , and bi := + e)] , we have that Oj < bi for all i. 

Additionally, bi+i/bi < 1 + 2e, since all bi > 1/e, and thus the ceiling operation can increase the value of (1 + e)5j 
by at most ebi. Putting these two observations together, we have 

^ ^ ^ A ^ (1 + 2^)"^+' 

L fli < L Oi < 5-^ . 

i=i i=i 

For any e < 1/2, we have that the support of gk,p,i/2,pmax,Pmin niost 

(l + 2e)I^V2+ ^^^^ )\ (l + 2e)^v2+ ) 

k 7^ ^ k 7^ 



£2 



, e 
< k — 



^(,l + \og(p,nax/Pmin)) 



e2 



□ 

Proof of Proposition^ The proof is now a simple matter of assembling the above parts. Given a distribution 
D over pairs of distributions of support [n], as specified in the proposition statement, the distribution D}^ is 
defined via the process of taking ^ D, then applying the transformation of Definitions [2] and [3] with 

e = 1/2 and to yield a pair (5fc,p,i/2,p,„„,,p^,„, fi'fc,pM/2,p™„,,P„,„)- We claim that this Dk satisfies all the prop- 
erties claimed in the proposition statement. Specifically, Lemmas [12] and O respectively, ensure that every dis- 
tribution in the support of has at most 2{k — 1) modes, and has support size at most 4A;e~*^^'^^°^^^'"''''/^'"™^^ 
Additionally, Lemma [T3] guai'antees that the transformation preserves Li distance, namely, for two distributions 

p,p' with support [n], we have Li{p,p') = Li{gk^p^i/2,p„,,,,p^,^, 9k,p',i/2,p,^ax,P,^.J- Finally, Lemma [m guar- 
antees that, given s independent samples from p, one can simulate drawing s independent samples according 
to Qi, „ 1 /o „ n ■ Assuming for the sake of contradiction that one had an algorithm that could distinguish 
whether Li{gk^p^i/2,p^a^,p^i^, gk,p',i/2,p,nax,Pmin) ^^^^ ei versus greater than €2 with the desired probability 
given s samples, one could take s samples from distributions {p,p') ^ D, simulate having drawn them from 
9k,p,i/2,pmax,Pniin Qk ,p' ,1 /2,pmax ,Pniin ^ ^^d thcn run thc hypothcsized tester algorithm on those samples, and out- 
put the answer, which will be the same for {p,p') as for {9k,p,i/2,p^ax,Pmin^ 9k,p',i/2,pmax,Pmin)- ^^^^ conti'adicts 
the assumption that no algorithm with these success parameters exists for {p,p') ■(^ D. □ 
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E Proof of Theorem m 

We first note that we can assume that e > Xjn. Otherwise, the decomposition of [n] into singleton intervals 
/j = {i}, i G trivially satisfies the statement of the theorem. Indeed, in this case we have that (1/e) • log n> n 
and pf = p. 

We first describe the oblivious decomposition and then show that it satisfies the statement of the theorem. 
The decomposition I will be a partition of [n] into £ nonempty consecutive intervals Ii, . . . ,l£. In particular, for 
j G [£], we have Ij = [rij^i + 1, nj] with uq = and n£ = n. The length of interval /j, denoted by li, is defined 
to be the cardinality of Ii, i.e., = (Given that the intervals are disjoint and consecutive, to fully define them 
it suffices to specify their lengths.) 

We can assume wlog that n and 1/e ai^e each at least sufficiently large universal constants. The interval lengths 
are defined as follows. Let £ G Z+ be the smallest integer such that 

EL(i+erj >n- 

i=l 

For i = 1, 2, — 1 we define 

h := l{l + ey\. 

For the £-th interval, we set 

e-i 

k:=n- Yl k- 

4 = 1 

It follows from the aforementioned definition that the number £ of intervals in the decomposition is at most 

0((l/e)-log(l + e-n)). 

Let p be any non-increasing distribution over [n] . We will now show that the above described decomposition 
satisfies 

dTv{Pf,p) = 0(e) 

where is the fiattened distribution corresponding to p and the partition Z = write 

n £ 

dTviPf,p) = (1/2) • E \Pfii)-p{i)\ = E dTV [{P}Y\p'') 

i=l 3=1 

where p^ denotes the (sub-distribution) restriction of p over /. 

Let Ij = + 1, rij] with Ij = \Ij\ = rij — nj^i. Then we have that 

dTV = (1/2) • E \Pfii)-p{i)\ . 

Recall that pf is by definition constant within each Ij and in particular equal to p^j = El^n i+iPi^)/^- ^^^^ 
recall that p is non-increasing, hence p{nj^i) > + 1) > > p{nj). Therefore, we can bound from above 

the variation distance within Ij as follows 

dTV {{PfY',P^') < Ij ■ {pijrij-i + 1) -p{nj)) < Ij ■ (p(nj_i) - p{nj)) . 

So, we have 

dTviPf,p) < E • iPi^j-i) -p{nj)) . (13) 
i=i 

To bound the above quantity we analyze summands with Ij < 1/e and with Ij > 1/e separately. 



23 



Formally, we partition the set of intervals Ii, . . . ,Ii into "short" intervals and "long intervals" as follows: 
If any interval Ij satisfies Ij > 1/e, then let Jq G Z+ be the largest integer such that /j„ < 1/e; otherwise 
we have that every interval Ij satisfies Ij < 1/ e, and in this case we let jo = ^- If Jo < ^ then we have that 
jo = ©((l/s) ■ log2(l/e)). Let S = denote the set of short intervals and let L denote its complement 

L = I\S. 

Consider the short intervals and cluster them into groups according to their length; that is, a group contains all 
intervals in S of the same length. We denote by Gi the ith group, which by definition contains all intervals in S 
of length i; note that these intervals are consecutive. The cardinality of a group (denoted by | • |) is the number of 
intervals it contains; the length of a group is the number of elements it contains (i.e. the sum of the lengths of the 
intervals it contains). 

Note that Gi (the group containing all singleton intervals) has | Gi | = 0.(1/ e) (this follows from the assumption 
that 1/e < n). Hence Gi has length 0(l/e). Let j* < 1/e be the maximum length of any short interval in S. 
It is easy to verify that each group Gj for j < j* is nonempty, and that for all j < j* — 1, we have \Gj\ = 
n ((1/e) • (1/j)), which implies that the length of Gj is fi{l/e). 

To bound the contribution to (fT3] ) from the short intervals, we consider the corresponding sum for each group, 
and use the fact that Gi makes no contribution to the eiTor. In particular, the contribution of the short intervals is 

Ei-{pT-pi) (14) 

1=2 

where pj' (resp. p^) is the probability mass of the leftmost (resp. rightmost) point in G/. Given that p is non- 
increasing, we have that p^' > p'|l^_l■ Therefore, we can upper bound ([T4l ) by 

"^■Pi + E pi - j* -pt*- 

1=2 

Now note that = 0(e) ■p{Gi), since Gi has length (total number of elements) il(l/e) and p is non-increasing. 
Similarly, for / < j*, we have that pf = 0(e) • p{Gi), since Gi has length il(l/e). Therefore, the above quantity 
can be upper bounded by 

0(e) • p(Gi) + 0(e) • '^^(^0 - / • pt = 0(e) • p{S) - j* ■ p+ . (15) 

1=2 

We consider two cases: The first case is that L = 0. In this case, we are done because the above expression ([T5] ) is 
0(e). The second case is that L 7^ (we note in passing that in this case the total number of elements in all short 
intervals is ft{l/e'^), which means that we must have e = Q{l/^/n)). In this case we bound the contribution of the 
long intervals using the same argument as Birge. In particular, the contribution of the long intervals is 

E l^.{p{nj^^)-p{nj))<{f + l)-p++ E {l,+i-lj)-p{nj). (16) 
i=io+i i=i()+i 

Given that Zj+i — Ij < (2e) • Ij and Ij • p{nj) < p{L), it follows that the second summand in ( [T6l ) is at 
most 0(e) • p{L). Therefore, the total variation distance between p and is at most (fTSl ) -1- ([T6l ). i.e. 

0{e)-p{S) + 0{e)-p{L)+p+. (17) 

Finally, note that p{L) + p{S) = 1 and p'j, = 0(e). (The latter holds because p~j, is the probability mass of the 
rightmost point in S; recall that S has length at least 1/e and p is decreasing.) This implies that ([17] ) is at most 
0(e), and this completes the proof of Theorem |5] 
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F Bounding variation distance 



As noted above, our tester will work by decomposing the interval [77,] into sub-intervals. The following lemma will 
be useful for us; it bounds the variation distance between two distributions p and q in terms of how p and q behave 
on the sub-intervals in such a decomposition. 



Lemma 15. Let [n] be partitioned into Ii, . . . , I^. Let p, q be two distributions over [n]. Then 

\ T r 

dTv{p,q) < E Wj) - Qilj)\ + E Pi^j) ■ dTv{pi,,qij)- 



(18) 



Proof. Recall that dTV {p-, o) = \ Yll=i ~ ^zC^) I ■ To prove the claim it suffices to show that 

^ E W) - < IWl) - qih)\ +p{h) ■ dTv{pi,,qh)- 



2 



(19) 



We assume that p(/i) < q{Ii) and prove ([T9l ) under this assumption. This gives the bound in general since if 

p{h) > q{Ii) we have 

\ E \p{^-q{i)\ < \p{h) - q{h)\ + q{h) ■ dTv{Ph,qh) < \p{h) - q{h)\ + p{h) ■ dTv{Ph,qh) 



where the first inequality is by ( [T9l ). The triangle inequality gives us 

Pih) 



\p{i)-qii)\ < 



Summing this over all i G Ii we get 



p{i) - q{i) 



+ 



\l:\p{i)-q(^)\<\T. 



ieh 



p{i) - q{i) 



q{h) 

Pih) 



P(h) 

liv ■ -7TT - qw 



q{h) 



We can rewrite the first term on the RHS as 



^ ieh 



p{i) - q{i) 



Pih) 



q{h) 



1 



Pih) ■ - E 



2, 



eh 



qih) 

p(i) q{i) 



+ TT E 



2, 



ieh 



/•^ pih) ... 



Pih) qih) 



pih) ■ - E \Phii) - 9/1 (0 



2, 



ieii 



= pih) ■ drviPh^qh) 
so to prove the desired bound it suffices to show that 

1 



E 

ieh 



We have 

and hence we have 
1 



E 

ieh 



qyi) ■ -rrr - qi^) 
qih) 



qih) 



■ E <i(^) ■ 

ieh 



<\pih)-qih)\ 
Pih) , 



(20) 



Pih) 



qih) 



qii) 



1 



qih) 



-Mh) ■ 



Pih) 



qih) 



1 



\pih)-qih)\. 



So we indeed have (1201 ) as required, and the lemma holds. 



□ 
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